(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
25 May 2001 (25.05.2001) 




II 



PCT 



(10) International Publication Number 

WO 01/37219 Al 



(51) International Patent Classification 7 : G06T 11/00 

(21) International Application Number: PCT/USOQ/30723 

(22) International Filing Date: 

10 November 2000 (10.1 1.2000) 



(25) Filing Language: 

(26) Publication Language: 



Rnglish 
English 



(30) Priority Data: 
60/166,499 
60/197,208 
09/648,956 



19 November 1999 (19.11.1999) US 
14 April 2000 (14.04.2000) US 
25 August 2000 (25.08.2000) US 



(71) Applicant: GENERAL ELECTRIC COMPANY 
[US/US]; 1 River Road, Schenectady, NY 12345 (US). 

(72) Inventors: EDIC, Peter, Michael; 55 Manning Boule- 
vard, Albany, NY 12203 (US). YAVUZ, Mehmet; 5319 



North McArthur Boulevard, Apartment 3056, Irving, TX 
75038 (US). ISHAQUE, Ahmad, Nadeem; 629 Kinns 
Road, Clifton Park, NY 12065 (US). 

(74) Agents: CHASKIN, Jay, L. et al.; General Electric Com- 
pany, 3135 Easton Turnpike W3C, Fairfield, CT 06431 
(US). 

(81) Designated States (national)'. DE, 1L, JP, SG. 
Published: 

— With international search report. 

— Before the expiration of the time limit for amending the 
claims and to be republished in the event of receipt of 
amendments. 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: METHOD AND APPARATUS FOR REFORMATTING TUBULAR VOLUMETRIC BODIES 



< 
r- 



i 



920 



, — 1012 

L 



(57) Abstract: Volumetric images of 
a vessel are captured by an imaging 
system and the volumetric images 
are reformatted into rectilinear data 
by a method, an apparatus, and a 
computer-readable medium storing 
a program. More particularly, 
volumetric data captured by an 
imageing modality is reformatting 
by isolating a structure, such as by 
dissecting a vessel from the remaining 
tissue, and stretching the structure into 
a rectilinear form corresponding to the 
structure. Reformatting the volumetric 
data corresponding to the structure 
includes partitioning a structure 
roughly from adjoining material by 
segmenting the structure from the 
adjoining material using a suitable 
CT intensity threshold, dilating the 
segmented structure, determining an 
axis of the structure along the entire 
length of the structure, determining 
planes at selected places along the 
structure's axis that are orthogonal 
cross sections of the structure, and 
reformatting the volumetric data along 
the planes to generate reformatted CT 
data. The reformatted CT data corresponds to data that would have been reconstructed by the CT imaging system if the structure 
had been pulled straight and the CT imaging system would have captured directly an image of the straightened structure. 
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rtft*^— ^ (projection data) j kit. tS«OS***r6j^5>St*Sr 

#6 0 h y y^JMB-r^-^ (volumetric projection data) J i: te N pj 

[0 0 2 4] 

#y a > h y ^ . fr-^£J&*Lfctg. CT^r^nyt 0 ^ 2 214 
^r^ffl^iJ 2 Afr^f-ZUy*— *y b • ^5 A 2 5 S:SK*iitf 0 
E 3 td^-r J: 5 te, m^X, rfV b y ?9 • r-^>«B^7- ^^^^ 

[0 0 2 5] 

rBrffiHtffey*— * (sectional image data) J fcHU $rSHtft> i"*fc*>, 3$: 
^fr^O»rB0 2^M^^^^LTV^57 ^ -^^or irT*fo4 0 BrffiiBffeT*— * 
(4 rjUMfcT*— ^(rectilinear data)j fcS^fcfc r^^^M^^ — ^ (recti line 
ar image data)j t t fc £>5o 

[0 0 2 6] 

R^)ltfc(DH«dS (specify) j S*L5 0 m&f—fffl. (image data set) 



(24) #*2pi5-5146O0 

o 

[0 0 2 7] 

0C>StSHT-fc5o 7 f -^ff7i~?5' h&l4 O'to^TIi, IH5~13£# 
[0 0 2 81 

r r-Cl3 4(cov>T8ftW-r5i:, jK!)^.^ h !) s* ^M^x-i? fi, 3te1\ CT 
[0 0 2 9] 

%vz>mm<Dmmt£k\ ikmrnv^o *vmt% (adjoini 

n g ) j ) nm^ts^k&ibZo &m^£? k-rzm^tfitemMMmx^ * 

limte-tzx-hz?. 

[0 0 3 01 



(25) ^¥15-514600 

*WmWX'mm-rZW&, r#!) ^> b'J vtWSt (volume trie structure) J 
<tl4, iO^t^ftf^Jc:, < ^rW-SU*fcl4^t Lt, -^StbTfct), 

fr|±**y ~> hy «7*flti&-Cfc9, £fc*y ^ h y y^ig^tfr i 

*i3tt/«coTv^v\ ^y^ hVy?mm<D mm tit, *>5W3£©Brt-e 

[0 0 3 1 ] 

JIM. *©*3t<0«tt«:«9)5ffitt, -t©«it©*fflto#©E8L 

(vermiform) j ft^frlSKOtt (\&l&Vi<n®iT'3bZ r i: <b fe-5) 

■CV^5J:5 4#y »^ r-y x^KBftorfc-CW. rro- 
LT^^ttSr ir tfc5o r*:Rj Wit i: 14, HKWfc:*#2n«]©*fcfc» 

^-ofKWifi^ffiffiiH^ic h-^x mmm tws ( r^-c^asometr 

ically isomorphic) J ) T'S>5*^fC, ^$ttfc^t^5„ 
[0 0 3 2] 

S7t-vy h«ii4 0(4, hy ^H&x — *rtK^£*l/r*i«5 JL 

vHBI-fe^ ^h»am Xt*»K**(dialation)*fls^trr £#S*L<^ 



(26) ^^15-514600 



[0 0 3 3] 
[0 0 3 4] 

# K: fc 5 BH 1^ l-ffi t5 5 « Jt © WEHIft * S . »tt K E<R L 

2o^±©fl*fa1»W«:aW1-5££fctt» #**5&;frft#J»r;iS 3 Djgjg^y y 
[0 0 3 5] 

iSfrffi© rrp]#j irfi, 3^7cJ-*5tt5*ffrt-^fefcii:^tti(D»l-*fbT^:<D»f 

5itiifl5„ 0iJx.fi, rwfo]^fi3^7Elcdo(t5-|S>:*S^;(D#^:lcit9. 
-Tftt?^ Ax+By+Cz+D=0ti»), &$LtZ> - £ /4 5 T*# S'Jfei L 

[0 0 3 6] 



(27) 



*frg¥l5-514600 



„ Lfc^oT, $>5®li, #Jx.fc£, (l) *<offi±^Str-^ l o©^^)ttt 
(2) ^roffitB^ir^SJi^^^li^Sr i:, icj; 9 M9i~t?> 

o 

[0 0 3 7 J 

hi) i/^®^-^(c^-r^ii*p*!iaS:tT5»f^4 i o itfs 

ommctt-rzu^i'S., u£Ltfj3^bn5#&atifi^io-t:-;fc6„ b&s* 

[0 0 3 81 

1140^4 0 2~4 0 r r X-m 5 ~ 7 £#J$ Lft# <bP*BK:fe 

[0 0 3 9] 

E1513:, H4<75g&f£4 0 2$rHn-t-5fcfe©^W^a$:*L/c^nil!T-fc.5 
- KllH? (seed pixel) j <hte, h y -y^Mtr-^Op ^rogg-L^B 

Itlltc^/i^oT^-Siij^^v'- KH^t^^r ir^fcS, KB* ti, *#J<£> 
iS^#c^!J y KB^x-^b^B^c^S^-y/u^ft^ j-^u-?A 
fjfrhVkH-rZZL t^HSLi^ SiJffitLT, ^-KBSili, *#]<D#y^7< H 

[0 0 4 0] 



(28) 



ft^httrnz-mn-rz* Sf^s 2 2(o^*^-fe^>-K^fijic < ttjH^*gE 

[004 1] 

S (segmented) J (■*-&*>*>, BB<C^«0>B3i i: «it£W«>m«>H3K £ (C^fiJ 
3*1. 5) Saa©ISMi:4oT^5„ »<frffi# JhtfrtE) 5fe-fb 

. ft«]©Bt<OBiMlcS^V ^TiltR IfcCTtLJl^fflV ^T^g 9 <omgk 

sa* Kg Jt 9 ffiv mm** h ft e>sisiJi-5 * fc « r. ©igcDS&S'JS- 

[0 0 4 2] 



(29) ^¥15-514600 



[0 0 4 3] 

£,-^FJ£(under-inclusion) ©^Cil6-ti:T4o< r itfW* LWc#, :©•>- 
BSS-fc^Vh) tttftf^5 4 2 (£:}o^TffiM&1-3o 3 battle aSt" 

m£&^7*ai?-mw*z®imLX!k i §&&i&£%ii-?> 0 zbi^ ikm^m 

[0 0 4 4] 



(30) 



|E<D 3 o<DiitRJ£<£> 5 *)<Oftf©8^ti:t5- Lfc^oT, @ 
5 com^f 5 4 2 1 LT> 5 3 2 T*j1#L LfcS«ttSil«:ttffl L*i4* fe 

, -fe^ ^ h#»^f£5 2 2 0**K*tUTWHEtfc*yU7*B5?-flt||[^-fca 

*^7tn v 5 — S^^y-iCOl^TcOf^MsBfi, Anil K. Jain (Prent 
ice Hal 1, Englewood CI iffs, NJ) \Z.£.Z> (Fun 
damentals of Digital Image Processin 
gj (1 9 8 9, 3 8 4~3 9 01) {C|H46^ttTV»5o 
[0 0 4 5] 

ra/i$iJ»t?.rti5st't5„ &f£5 4 2-e#e,ti5 r-^^^ ( ma 

s k) j »4, $fci\ -Wg»ffi©«!WfcLfc«*l:LTttffl3jT,, m^TcJcbT 
[0 0 4 6] 

h y y ^i«f-^ olir n 1 icM Ltv^^s, 2iijS:oflt (•*-**>*> 



(31) 



$5*^15-514600 



, 0£fcf4i) L^*LTv^*v^ip4 3»C7c^iB5iJT*fes 0 Z(D-?x?mmit 

[0 0 4 7 ] 

0 6 14. H 4 0>t*fM 0 4 ©A#tt**lfi^— «I8 t»»lc^i-aEtLH-C&5 

(masked slice image) J ) £Jfj^ 6 r t K <fc 9 US £tb>5o *#J<Otffy ^ 
* M) • *fi, ffii&MK^y ^/ Kco^y y K/felcJ: 0HS*4x5*tlS"rS 

I'T^rv'^A' • *(axial slece) J ) £r^LT^5 0 HI 6 OJWT^ 

fcttKLfc^T, »«t-S#M«ffirt0 2o(0»:7c*|pl»4x**i: yttlicj; «9«^$ 

[0 0 4 8] 
[0 0 4 9] 

tfkfls 6 3 4CJ:^ > h oihJIJfr* £ ft s ilflq©;* 9*f * 

tfef£6 4 4 tci ^^O-e^^^a^^^^H^SriltRLT, 8MS*«4JMts6 2 



^¥15-514600 



[0 0 5 0] 

, »«s6 5 4ICittf. Lfc^oT, x c fcx*— > V HKHJEL<M!J£U y c £y 
iCwfc (x c , y c ) as«3t$*t5. Mkf^6 2 5 4tt, #J;tf£#:<£> J: 9 K 

[00 5 1] 



[0 0 5 2] 

*<0««6«Jli«fflB*rn^9ASR (C, C + + , 7t-h7X (DjiM 
y^fat'-g-f+U y*-fplT*<Dm^f+(tL/i r^H(mass)j 



1*1] 



for i = 0, nSlices - 1 do begin 
t = mask(V.i) 



k 




endfor 



(33) #**P15-514600 



10 0 5 3 J 

&<^T% ^6 6 4|dio^T, 2#:5E t l J 'Cw6 (x c , y c ) £ 3 &5tO,£ £ M 
*©*7'l'*©tfB»r , 'C.\£ (x c , y c ) iiHilttttS, :©ig*iLT, 

[0 0 5 4] 

#C^T\ 7 4K*3^T, i©3»:7ct.MlC*|-LT3|>:7nfti^atli 

[0 0 5 5] 

Tft^STlii?) (curve fitting) J <b tt\ *B^»#T-(i, ^f-^Oi?^ ^(DftH 
(-?-&*?*>, r-i£ (family) J <D&m (d^LT, 1£0 1fflffljfi©|ta<|; 

£Mu -to^^^^^— ^-e*m$tiTV^ l*a©*ii©^Stc:j; 9tg££ 
ft5±5fciiia©ilMto¥©::£S:^5. ^rt©iS©A«*)^ioii, filSc 

[0 0 5 6] 



(34) 15-5 14600 

cewise-defined function) b ^X&gk&mM-fZ) r b ii~^ifeX'&>Z> 

^cDHftOj&^-g-fr-ti: (-f&^*>, Sta-g-fc-a:) b L-C**&&j£L-C^3. ft 

[0 0 5 7] 

;*5oT, SK<0«iro®^7 :r -^S.O ; ^LTV^5ft^^SbTI4, 8ifg<oaiJS^ 
[0 0 5 8 J 

J:<»b*Lfc**ftft|»aTH:ai>ftlfl:»|ia»6«R1-ar HTftS. ftH^ 
9j£||£;|x4 % -m<Z>;<7* hV ~y?&mb-tZ>^bi>hZ>. %mb L 

r, ari46»ff6 7 4tt, m^^^v-o-mm 4 -ecoM.) 

[0 0 5 9] 

0 7(4, 0 4©^«»f«Iff4 0 6 ^^mi--5fc*©^l«Sr*Lfc^n 



(35) 



? • ?*— LT^S. 
[0 0 6 01 

DOM**'!* y KlcJ:9ft^$ix5a«lEi-5iaD»*t^7-l'^BIfeOzffi«ti-Si 
&m-Qt±tj:\/^ (z = 0) Sr, ii^liJfeWwS^^gp 

Wt»&KVmisik&z.klfi&&l,*\ m&tLX, :©zlii, ikfic?&oT 
ElBtftMHMi fc: E# $ J; o \z.WRt 5^tm„ 
[0 0 6 11 

tfXk£#£-f -5,, ^fpl^J^z^e^it^^y y KBWHoiooiOz 
flCB-CfcS <fc 5 fc»£-|£tt, £4>&Attl|iMK:, @ 6 W»f^6 2 4 ~ 6 5 4 life 

v * x w-g l fc^K^ <d 3 j^^c 4> ©fist £ *> a jk $> -s ^ »* r <D&<Di&m i- 

[0 0 6 21 

5|p]f ^^^tuS,, *^6<j/«cHJg(0— r<£>ig#I-f Sft^KJ; ft 

w^e (-*-**>*>, ^iRi9)Wfww*ffi«) ^n-*-ra„ 

[0 0 6 31 

s^issrtHL-rar kicavjkfei-z- t&x-zzo mmtLx, m^^m<o 
$>s) tu«iu^^7^ hy y^sssiaotstsr 



(36) 4#$¥15-514600 



a, b, c) li, xS^yrozid^ti-^WMS^fj^ai-ft^T'tSo 
[00 6 4] 

[0 0 6 5] 

a x + by + c z + d = 0 

ft5r iCOiff^^S^gt^t; (d i s c r e t i z e) Lt, ^ 

[0 0 6 6] 

vitwjymtt'tih, z commit, mn^m^t^^^y-^x-h^t, m&K 

feW"?*^. Lfc/JSoT, #W*n«-eW:, ffil&Ofcibr. 5 Lfcf¥#ffl(C 
[0 0 6 7] 

#«436ri«il9JWrBi*©H*«[J4s BjSMKj/y y K±T**tiSf^fo5 8o 

Wifi»iB*it*»e)© NT-Y V-T ( t r i 1 i n e a r) MfMHc J; 9 r 

ir#T*#5. *fcififl»-*>S8o©i5BMBSrNi (1 = 1, 8) t?*-f 

t , ^(p]^J»f<0@i*ffi xsection (j, k, i) fi&CD J; o ic&JTr-t 

[0 0 6 8] 

mi] 



(37) 
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xsection(y , k,i)- ^ a, N, . 



[0 0 6 9] 

::t*, l^ai l^*|»]«x section (j, k, i) i:iIii{f{iNi 
[0 0 7 0] 

[St2] 



[0 0 7 1 ] 

:fflffifAi*OH, ^Wttix section (j, k, i) SrSip 
ctional volume) JrttJTCSS. *tWtf »KM-f5 - O^lftlglfc^ffitCOl^T 

tt, Ell 3Sr#fl8U/j:^6£ATT?KW-*-5o 
[0 0 7 2] 

SriS^-r5^t?$>5»f^7 8 6 fcit^ »f^7 3 6 (CM-5o &jjfa9)mh*-t'< 

xfti&ftfr-ehzm&i^ ei7©&3#j||ttj*Tl-a. 

[0 0 7 3] 



(38) 



[0 0 7 4] 

o iff <* «c & -5 <t o ic: r © jfiL^F £ g | # a rf l x ^ -5 „ 

[0 0 7 5] 

5 0%/SQRT (2) h^^, h?rtt2.r tK&Stf*, aWl+SOT-W, 

[0 0 7 6] 
[0 0 7 7] 

?IC£ 9 UhjMFfflS^ 8 0 0O3DaftOWf*5 0 I5®ftff5 1 2 
&&mirZ>k^ H8<£>v— KiUSfS l Oli, #y 3.^ M s^H&t*— ^cofct 

2©i|6*, ^SWCt;/^ ^ h##]L7tv— KM***"* V h 8 2 0^#P>H-5 



(39) 4$*5pl5-514600 

mm (ffli8 4oit*) *»e>flwj$n*. 

[0 0 7 8] 

m 8 T'tt, L^l <t tJ . v— -fe ^Vh 8 2 0 #SSH 

£jM?fflt#8 0 OSrii-o Tiffin LTj®tf£«fc 5KUt^5. LfcdSoT, @8<D 
KH*8 1 0 &m*'*Xik l g<Dm*$&f&&£ltZ Z t#X-£ Z 0 r <£>•>— Ktt 

poral window) r. 5 Lfc#-S-Kte, L #VHfi©»& (Uc^oT, 

[0 0 7 9] 

9{£^&&©BifcriSM&K^*;ft5r Clefts. J: 5ffiv^*©H3Rtt, *©» 

-t<?5«5gWn-yU^-7(roll-off)i: LTS^^tt'Sr ttc/i^,, «fc 9 
^©^©■f'k©^ KffilLTV^ *S«Uctt, iMF>f * ^if^m&BL 

[0 0 8 0 J 

@9lt BI5CD^^^^SI^5 4 2 Sr^LfcfeOT'foSo ^WX^-Ti. 5 
. »36*!ftlftf^fcJ: t> v-- KI*t^^ v h 8 2 o «r»3g£ifc3*T\ J; 

3*6. r©»3R3eijmkf^-C»4, fl-fat tCifct 8 0 0 ©iO*|S] 
fcGU&»oT-fc*> > h 8 2 0 $r»»£*-r3©as*ii-e*>.5. 8i3g^#lftf££ 1 



(40) ^5pi5-514600 

o 

10 0 8 1] 

m 1 0f2H6<D®g^mi-:tfJSL.-t^.5„ HI 1 0 jC^i" <fc 9 Jhwi-^js-r 

commit ? y ? \?&&mtLx z¥-ffiizm*-Mtetcx, y^no 1 2- 

• ^.df-r v©*f*|S||rIl 0 2 2~1 0 2 8£»j^U r <£>&;£fr»r®2r 
[0 0 8 2] 

0 1 0 d^i-J; 5 fEv^^ 9 2 0ll 4frfTL7fcRt§5^£L 
[0 0 8 3] 

ill 0 2 2t£t'<D!k i §<Dm.^^V y KWSt^ 20©fe (x, y) icfc 

^0»<o»rS) AmbtiZo 
[0 0 8 4] 

(Hi lti, fE9 2 OOft^f^Ott^^^-r^/c^WHiecD^S^IifiW 
tii^lcMlTV^, 3^tt^l 1 0 Ott, fikf^6 7 4ia!)>PMl 1 2 2 
-112 8l£*fLTfti»ST««>&gtt5, — 2f£<Dl>£w£l 12 2 — 1128 
l*Bl6©»f£6 2 4-6 5 4TH-S$n51i>t*J)5 0 ±i£ LfcJ; 9 **tfc 



(41) 4#S¥l5-514600 



[008 5] 

11211 El7|c^L/t^g|#)iito^Jc:^L-Cv^-5c zttl 2 0 0»i. El 
6©M6 7 4T*#fcft^|i)Ofilfti&S7^-vy h L-tzi>(Db%m-Q&>Z> 

. H2i2~i2i8tt, ^ftiaBfrw&ffijc^LTfctK :jxbroius 
7*-v5/Firof-^tliffirfi.5„ fflBVrSl 2 2 2~1 2 2 814, ff7 
h'&<Dlh i gfh&l 2 2 0<D*#*(6J(D«6 1 2 0 OlCffio/c^n^tt©^ 

[0 0 8 6] 

Ell 311, 0 7©»fls7 6 6-?3SfT£*l5 h7-f !) =T»IHSr* Lfcfc Otfc 

iiSfcSo Sftt 1 3 0 0 (4, ^(DWm^.&WMW V v YW& 1302-131 

, #J;LI4\ H^l 3 0 0 05itt^{4a(^LTia:g (xint, yint, zi 
n t) (C&eLTI^-So 3 2 014, &g (xint + 1, yint, 

z i n t ) (C*tJSf5WSf 1 3 0 6 tttft%fa<OB:tt(DtiLmz$3Zo dfdxm 
*dyp*dzpll B7 0lft^7 6 6 (CBB LT±j& Lfc «fc ? 1*1 3 0 6 

[0 0 8 7 J 

T*f4, B7t-vj/ h LTV> 5^-^(4, ft£ 6~1 0 5 JJ ^ — (mm) <D 

tiift $ nfcg|5# J; 9 ft £ # ± 9 fiv \ 

[0 0 8 8] 

*&W<0^<D9mm-e&. #«¥ES«/& (MP R) 



(42) 



[0 0 8 91 
10 0 9 01 

[0 0 9 1] 
[0 0 9 2] 



(43) 



i frftig l^*s Lit*&w<Dmmi£wmirz>±&<ommz®m-z ^tiz 

*ft(DffiW&a&tfft#lCgg1-£ft££ffoT^-5 (Hl7(OSf^7 16-7 5 6 
[0 0 9 3] 

[009 4] 

#fcSffl14^i^i/^^ir Lt, #389! tt, jMf«><l$», &5t^i»«S:-&tffe^ 
[0 0 9 5] 



(44) 
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[Hi ] 
[12] 

W (- <£ S x j^>;* ^ A * li = > fa - * mmwt& 7- a coMSEl T-fc 

So 

[13] 
[H14] 

#$8w«c i -s -)3fe(Dmtmx-&> s„ 

[05] 
[06] 

im7] 

[08] 
[09] 
[010] 

n c <t s a^&i^ftiffc s„ 
[0ii] 

[012] 

##9§k: «t s ^ffioPHa^a^^-r0T"fo s„ 

[013] 
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w ic j; 5 ^feo^^^a^^t-m-efe 3 0 

1 0 ^ft^^^-v^V^ • v-^xA 

1 6 ££f# 
l 4 

1 2 Jiff 
18 

1 9 7 ? -*lR*=i>'#-*>' h 

2 o M«KB 

2 4 ^7A|^!J 

2 6 m^mm 

3 4 — • v-^^A 

2 5 7*— *S:7*~ *y V • ^n^A 

8 0 0 #y a* h y y^H^—^twJ: 5*SlLfcifiWSK4> 

8 10 KB!* 

8 2 0 $/— K®*i?^ > h 

8 3 0 *£fr^S^®*^kftSffi« 

8 4 0 /h^^I^li^b^SM 

9 2 0 t;*^ 

1012 — 1018 x, y 
1022 — 1028 #4*r*]E£rffi 
1 1 0 0 3&7t;f&IS 
1122—1128 
1 2 0 0 z# 
1212-1218 ffi 
1222 — 1228 tfftWf ffi 

1300 mm 

1 3 0 2-1 3 1 8 BJMK^y jy KM* 
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